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We introduce transverse ferromagnetic interactions, in addition to a simple transverse field, to 
quantum annealing of the random-field Ising model to accelerate convergence toward the target 
ground state. The conventional approach using only the transverse-field term is known to be plagued 
by slow convergence when the true ground state has strong ferromagnetic characteristics for the 
random-field Ising model. The transverse ferromagnetic interactions are shown to improve the 
performance significantly in such cases. This conclusion is drawn from the analyses of the energy 
eigenvalues of instantaneous stationary states as well as by the very fast algorithm of Bethe-type 
mean-field annealing adopted to quantum systems. The present study highlights the importance 
of a fiexible choice of the type of quantum fluctuations to achieve the best possible performance 
in quantum annealing. The existence of such flexibility is an outstanding advantage of quantum 
annealing over simulated annealing. 
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I. INTRODUCTION 

Combinatorial optimization is one of the central prob- 
lems in computer science A celebrated example is 
the traveling salesman problem, and many instances as 
well as this problem can be represented in terms of the 
Ising model, often with disorder or frustration [2|. In 
such cases, optimization corresponds to the search of the 
ground state of the disordered/frustrated Ising model, a 
highly non-trivial task also from the viewpoint of physics. 

Simulated annealing is a generic prescription suited for 
such purposes [1]. One introduces an artificial tempera- 
ture variable to control the average energy through ther- 
mal fluctuations. By decreasing the temperature gradu- 
ally from a very high initial value, one hopes to eventually 
reach the ground state in the zero-temperature limit. 

This prescription of simulated annealing intrinsically 
restricts the control parameter only to the temperature. 
Also, the actual implementation of simulated annealing is 
exclusively realized by classical Monte Carlo simulations 
with time-dependent temperatures. 

In contrast, quantum annealing makes use of quantum 
fluctuations to control the behavior of the relevant sys- 
tem 0, H, H, 0]- Fluctuations of quantum nature are 
introduced artificially to the classical optimization prob- 
lem represented by a disordered/frustrated Ising model. 
One initially sets the coefficient of the quantum term 
very large so that the system searches very wide regions 
of the phase space for the optimal state. A gradual de- 
crease of the coefficient of the quantum term yields an 
adiabatic evolution of the ground state starting from a 
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trivial initial ground state, and leads to the non-trivial 
final ground state, which is the solution of the original 
optimization problem,. We have some degrees of free- 
dom in the choice of a type of quantum fluctuation. In 
addition, the implementation of quantum annealing can 
be made in a variety of ways including an exact numer- 
ical integration of the Schrodinger equation (for small 
systems) , quantum Monte Carlo simulations [1, [§] , and 
Green's function Monte Carlo method p^ . 

Most studies of quantum annealing so far have put 
an emphasis on how fast quantum annealing performs, 
relatively to simulated annealing, with a single type of 
the quantum term in most cases, namely the transverse- 
field term added to the classical Ising model representing 
the original optimization problem. Evidence has been 
accumulatin g to establish generic superiority of quantum 
anneahng 0^11 [12. 

In the present paper we focus our attention on a dif- 
ferent aspect of quantum annealing, flexibility in the 
choice of quantum terms. In particular, we investigate 
the random-field Ising model, for which quantum anneal- 
ing with the conventional type of quantum term has been 
shown not to perform efficiently under certain circum- 
stances [111. We introduce additional terms of quantum 
nature, transverse interactions of a ferromagnetic type, 
by taking advantage of the fiexibility in quantum anneal- 
ing. The result shows a significant improvement, from 
which we conclude that the reduced efficiency of quan- 
tum annealing in comparison with simulated annealing 
reported in some cases may not necessarily reflect intrin- 
sic limitations of quantum annealing. Rather, we expect 
that an appropriate choice of quantum terms would of- 
ten accelerate signiflcantly the convergence of quantum 
annealing to the ground state. This feature of flexibility 
is an outstanding advantage of quantum annealing. 
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We organize this paper as follows. In Sec. |TT1 we 
first explain the basic ideas of conventional quantum an- 
nealing and quantum annealing using transverse ferro- 
magnetic interactions. We then analyze the instanta- 
neous ground state and the first excited state by nu- 
merical diagonalization. Advantages of transverse fer- 
romagnetic interactions as a driving force of quantum 
annealing are pointed out. In Sec. IIIIl quantum anneal- 
ing by transverse ferromagnetic interactions is carried out 
for systems of large size using the Bethe approximation 
as an algorithm for practical implementation. We then 
present results of simulations and compare residual errors 
of conventional quantum annealing, quantum annealing 
by transverse ferromagnetic interactions, and simulated 
annealing. Section ITVl is devoted to conclusion. 



II. TRANSVERSE FERROMAGNETIC 
INTERACTIONS 

A. Conventional approach 

In the present paper we consider the problem of 
ground-state search of the random-field Ising model. The 
Hamiltonian 
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where erf is the z component of the Pauli matrix, is re- 
garded as the classical potential term in the context of 
quantum annealing. For this system, it is known that 
the conventional approach to quantum annealing using 
the transverse field as described below does not perform 
impressively when the interaction term in Eg . ([T]) is dom- 
inant relatively to the random- field term [IjI . We choose 
the two-dimensional square lattice and the random field 
is assumed to be either -1-1 or —1 with equal probability. 

In the conventional approach, one adds a term of trans- 
verse field to Eq. ^ 
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which may also be regarded as the quantum kinetic en- 
ergy, to induce quantum transitions between classical 
states. The strength of the quantum kinetic energy is 
controlled in the present paper by a linear function of 
time, 
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with r being the time assigned for annealing. The initial 
state is chosen to be the trivial ground state of the kinetic 
term = {2)J(| T), + | ^)^)/^], where | T)^ and | i), 

are the eigenstatcs of af with the eigenvalues 1 and —1, 
respectively. It is expected intuitively that the system 
evolves adiabatically following the instantaneous ground 



state if r is very large, reaching finally the non-trivial 
ground state of the potential term H^^^^ at t = r [l3] . 

The quantitative criterion for such an adiabatic evolu- 
tion is 
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where |(^i(V''')l^l*o(V'''))lmax denotes the maximum 
absolute value of the matrix element of A between the 
instantaneous ground state and the first excited state 
^'i. The numerator e,nin is the minimum energy gap 
between the instantaneous ground state and the first ex- 
cited state. The residual error, the difference between 
the obtained approximate energy aX t — t and the true 
ground state energy of HH'^, is of ©((Tc/r)^) if the 
condition (jl]) is satisfied [15]. 

It is therefore important to find an improved quantum 
kinetic term to enhance the gap Emin and suppress the 
transition matrix element |(\E'i(t/r)| • |*o(i/'''))lmax- 
tice that the potential term Ti^^^^ is given and fixed, and 
our degree of freedom lies in the choice of the quantum 
kinetic term. This flexibility is an outstanding feature 
of quantum annealing, which has not necessarily been 
fully exploited in existing studies using almost always 
the transverse-field term of Eq. 



B. Transverse ferromagnetic interactions 

We now try the following operator as the quantum 
kinetic term in place of TiJ;^ of Eq. ([2]), 



^kin = ^ 2^^i ~ 2^ ^3 ■ 
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The time evolution of the system is governed by the time- 
dependent Hamiltonian similar to Eq. ([3]), 



In Eq. ^ the sum for interactions runs over the same 
pairs of sites as in the potential term ([1]). The ground 
state of Eq. (O is the trivial ferromagnetic state in the 
X direction as in the conventional case. The overall sym- 
metry (by the operation erf — > —erf) is broken by the 
transverse field term as is necessary to guarantee the 
uniqueness of the ground state. For simplicity we fix 
the coefficients to unity in Eq. (O and do not try to op- 
timize the ratio of the coefficients of the transverse field 
and interaction terms. 

As a preliminary analysis, we have evaluated the char- 
acteristic time Tc of Eq. ([¥]) by direct diagonalization 
of Tiit) for small systems. Figure [T] shows the energy 
gap between the instantaneous ground state and the first 
excited state for the system with nine spins {N = 9) 
under the configuration of random fields indicated on 
the left panel. The interaction constant is J = 2.0. It 
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FIG. 1: Instantaneous energy gaps between the ground state 
and the first excited state of the time-dependent Hamiltoni- 
ans for systems with A'^ = 9 spins. The coupling constant 
in Up™ is set at J = 2.0. 'TP' and 'FF in the figures 
correspond to the kinetic Hamiltonians Til^Zi Eind "W^in, re- 
spectively. The configuration of random fields is depicted in 
the left panel, where open circles indicate hi = +1 and filled 
ones hi = —1. 
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FIG. 2; Absolute values of the matrix element, 
K*i(t/r)|dH(t)/d(t/r)|*o(i/r)>|, for the system of Fig. 

m 
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FIG. 3: Instantaneous energy gaps (upper panel) and absolute 
values of the matrix element (lower panel) for the random field 
configuration of Fig. [T]with J = 0.6. The energy gap between 
the second excited state and the ground state is also plotted 
in the panel for TF. The abrupt change of the matrix element 
in the TF panel is due to level crossing of the first and second 
excited states. 



III. MEAN-FIELD ANNEALING BY THE 
BETHE APPROXIMATION 



is observed that the minimum value of the gap emin is 
larger for the case of transverse interactions (FI) on the 
right panel than for the transverse field (TF) case on 
the left panel: Emin/^mfn = 2.89. The absolute value 
of the matrix element appearing in Eq. ([4]) is depicted 
in Fig. [51 This quantity is also larger for FI than 
for TF, the ratio being 2.01. Thus the ratio of Tc is 
tFI/tTI' = 2.01/2.89^ = 0.24. We therefore conclude 
that quantum fluctuations by transverse ferromagnetic 
interactions lead to much shorter characteristic time than 
the conventional counterpart for the present system. A 
similar tendency was observed for a larger system with 
iV = 20 and J = 2.0. 

The situation changes for J = 0.6 as is seen in Fig. [S] 
The ratio of characteristic times is now rf^ ItJ^ = 1.21, 
suggesting a slightly slower convergence under the trans- 
verse ferromagnetic interactions. Nevertheless this dete- 
rioration by 21% may not be quite significant in compar- 
ison with the much larger gain of 76% (= 1 — 0.24) for 
J = 2.0. 

In the next section we shall see the consequences of 
these observations from a different point of view. 



Implementation of quantum annealing for large sys- 
tems is often carried out by quantum Monte Carlo simu- 
lations based on the Suzuki- Trotter transformation p^ . 
In the present paper we instead make use of the method 
of mean-field annealing with the Bethe-type approxima- 
tion [l3] ■ The basic idea is to solve a set of equations for 
local magnetization iteratively. There are several reasons 
for the choice of this method. First, our main objective is 
to study the relative effectiveness of transverse ferromag- 
netic interactions and transverse field as the quantum ki- 
netic energy. The present approximation is likely to affect 
both approaches to a similar degree, and therefore the 
relative performance is expected to be largely unchanged 
by the introduction of approximation. Second, the mean- 
field annealing is much faster than quantum Monte Carlo. 
The former may therefore be suitable for practical pur- 
poses under appropriate circumstances. Third, we can 
follow the ground state directly in the mean-field anneal- 
ing without introducing small but finite temperatures as 
in quantum Monte Carlo. Lastly, the implementation 
of quantum Monte Carlo involving transverse ferromag- 
netic interactions is a little more complicated than the 
case of simple transverse field only, whereas mean-field 
annealing can be formulated easily for both cases. 
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FIG. 4: In the Bethe approximation one focuses on a site 
i and its immediate neighbors. All other site variables are 
replaced with their averages. 
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A. Bethe approximation 

To achieve the best possible results within mean-field- 
type methods, we employ the Bethe approximation in 
place of a simple single-body mean-field theory. One fo- 
cuses on a site i and approximates the Hamiltonian in- 
volving i by the cluster Hamiltonian (see Fig. 2]) 
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FIG. 5: Residual energy for the random field Ising model 
with J = 2.0 averaged over 80 configurations of random fields. 
Filled squares and triangles indicate the results of quantum 
annealing by transverse interactions (TF) and by transverse 
field (FI) , respectively. Open circles are for simulated anneal- 
ing. 
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FIG. 6; Histogram of the residual energy at r 
parameters are the same as in Fig. O 



100. The 



where j is a neighboring site of i and fc is a neighbor 
of j excepting i. For this Hamiltonian one calculates the 
ground-state expectation values of erf , cr| , erf and crj , giv- 
ing mf,m^,mf and mj, respectively. The same process 
is repeated by shifting the center site i of the cluster. Af- 
ter scanning the whole system, one updates the time vari- 
able. The same idea applies to the conventional quantum 
annealing, in which one drops the transverse interaction 
term. 

For comparison the same Bethe-type mean-field an- 
nealing was tested for simulated annealing using thermal 
fluctuations. In this case the kinetic term Hy.-^^ is dropped 
and temperature is introduced to calculate the thermal 
expectation value mf of erf. The same linear annealing 
schedule T = Tq ■ {1 — t/r) was used with a sufficiently 
high initial temperature Tq. 



B. Results 

We have applied the method above described to the 
random-field Ising model with the system size 100 x 100 
in two dimensions. The residual energy was calculated as 
the difference between the obtained approximate energy 
and the true ground state energy estimated by a well- 
established algorithm [T8| . 

Figure [5] shows the result for J = 2.0 averaged over 
80 samples, and Fig. [6] is the histogram of the residual 
energy at t — 100. It is clearly seen that quantum 
annealing by transverse ferromagnetic interactions is far 
more superior to the other methods. Simulated annealing 
and the conventional transverse-field quantum annealing 
perform almost similarly, the former being slightly bet- 
ter probably owing to the difference in the effects of our 
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FIG. 7: Residual energy for J = 1.5. Other conditions are 
the same as in Fig. [5] 



FIG. 9: Residual energy for J = 0.6. 
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efficient results than simulated annealing p^ . 
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FIG. 8: Residual energy for J = 1.0. 



approximation to thermal and quantum annealing. 

A similar situation is found for J = 1.5 in Fig. [T] 
The difference between various methods diminishes as J 
decreases further, see Figs. [5] and [HI 

Our method works efficiently for large J, in which the 
true ground state is either exactly or close to the ferro- 
magnetic state. Introduction of transverse ferromagnetic 
interactions does not necessarily improve the result for 
the cases of disordered ground states. This observation 
is to be compared with the finding of Sarjala et al. (Tsj 
who showed by quantum Monte Carlo simulations that 
quantum annealing by the conventional method is less 
efficient than simulated annealing when the ground state 
is strongly ferromagnetic. We may conclude that their 
consequence does not necessarily reflect intrinsic features 
of quantum annealing. Sophisticated implementations of 
quantum annealing can significantly improve the perfor- 
mance. The same may apply to the problem of 3-SAT, 
in which quantum annealing was observed to give less 



IV. CONCLUSION 



We have discussed the effect of the introduction of 
transverse ferromagnetic interactions to quantum anneal- 
ing of the random field Ising model. The exact diago- 
nalization study on small systems revealed that trans- 
verse ferromagnetic interactions shorten the characteris- 
tic time, Tc, from the value given by the conventional 
transverse field when the interaction constant J is large. 
Then we compared residual energies after quantum an- 
nealing by transverse ferromagnetic interactions with 
those by conventional quantum annealing using trans- 
verse field and simulated annealing for large systems. In 
order to carry out quantum and thermal annealing in 
larger systems, we employed the method of mean- field an- 
nealing based upon the Bethe-type approximation. The 
results of mean-field annealing showed that quantum an- 
nealing by transverse ferromagnetic interactions is far 
more efficient than the other two schemes for large J. 
This implies that the previously reported fact on the re- 
duced efficiency of conventional quantum annealing for 
the ferromagnetic ground state is not an intrinsic fea- 
ture of quantum annealing, but a better efficiency than 
simulated annealing can be obtained by exploiting an ap- 
propriate quantum effect. It is important to make use of 
the room of choice of quantum fiuctuations to extract the 
best performance in quantum annealing. Such ficxibility 
is an outstanding character of quantum annealing that 
does not exist in simulated annealing. It may be also in- 
teresting to take into account many-body interactions of 
the form — crf^crf^ • • ■ in the mean-field quantum an- 
nealing. 
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